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"IMAGE PROCESSING METHOD FOR AUTOMATIC ADAPTATION OF A 3-D DETORMABLE MODEL 

ONTO A 3-D SUBSTANTIALLY TUBULAR SURFACE OF AN OBJECT 

Descriptfon 

Field of the Invention 

5 The Invention relates to an image processing method for automatic adaptation of a 3- 

D deformabie mesh model onto a substantially tubular surface of an object in a medical image. 
The Invention applies to methods of segmentation of a three dimensional tubular object in a 
three dimensional Image, which often comprises an operation of fitting a three-dimensional 
discrete defomnable model onto said three-dimensional tubular object The invention further 

10 relates to medical imaging apparatus or systems and to program products for prejcesslng 
medical three-dimensional images produced by those apparatus or systems, for the 
segmentation of objects that are body organs such as colon or arteries in order to study or 
detect organ pathologies. The invention finds a particular application in the field of medical 
imaging methods, program products and apparatus or systems. 

15 Background of the Invention 

A technique of modelization of a 3-D object Is already disclosed by H. DELINGETTE in 
the publication entitled "Simplex i^eshes: a General Representation for 3D shape 
Reconstruction" in the "processing of the International Conference on Computer Villon and 
Pattem Recognition (CVPR'94), 20-24 June 1994, SeatOe, USA". In this paper, a physically 

20 based approach for recovering three-dimensional objects is presented. This approach is based 
on the geometry of "Simplex Meshes". Elastic behavior of the meshes is modeled by local 
stabilizing functions controlling the mean curvature through the simplex angle extracted at each 
vertex (node of the mesh). Those functions are viewpoint-invariant, intrinsic and scale- 
sensitive. A Simplex l^esh has constant vertex connectivity. For representing 3-D surfaces, 

25 Simplex Meshes, which are called two-Simplex Meshes, where each vertex is connected to three 
neighboring vertices, are used. The structure of a Simplex Mesh is dual to the structure of a 
triangulation as Illustrated by the FIG.l of the cited publication. The contour on a Simplex Mesh 
is defined as a closed polygonal chain consisting of neighboring vertices on the Simplex Mesh. 
Four Independent transformations are defined for achieving the whole range of possible mesh 

30 transformations. They consist In inserting or deleting edges In a face. The description of the 
Simplex Mesh also comprises the definition of a Simple Angle that generalized the angle used 
In planar geometry; and the definition of metric parameters, which describe how the vertex is 
located with respect to its three neighbors. Dynamic of each vertex is given by a Newtonian law 
of motion. The deformation implies a force that constrains the shape to be smooth and a force 

35 that constrains the mesh to be dose to the 3-D object. Internal forces determine the response 
of a physically based model to external constraints. The internal forces are expressed so that 
they be intrinsic viewpoint invariant and scale dependant Similar types of constraints hold for 
contours. Hence, the dted publication provides a simple model for representing a given 3-D 
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object. It defines the forces to be applied In order to reshape and adjust the model onto the 3- 
D object of interest* 

Summary of the Invention 

In medical Images, It Is often requfred to segment a tubular organ like the colon or an 
artery. A segmentation based on discrete defomiable models allows to extracting clinical 
parameters of the studied organ like the diameter or the volume. Problems arise when the 
discrete defomiable model, whether of the kind called two-Simplex Mesh, triangular M^h or of 
any other kind of active contour Models, must fit such a tubular organ that presents numerous 
bends. These bends may have different curvatures, defined by small or large curvature radii. 

It is an object of the present Invention to propose an Image processing method of 
creating a deformable model, with 2-simplex meshes or triangular meshes or any other kind of 
meshes, having a tubular structure for fitting a previously defined 3-D path composed of a set 
of ordered points. This 3-D path may correspond to the centeriine of an object of interest, i. e. 
a tubular organ showing bends. Thus, said 3-D path may present all kinds of curvatures. It is a 
ftirOier object of the present Invention to propose such an Image processing method for 
automatic adaptation of the mapping of the 3-D deformable tubular model onto the 3-D surface 
of the tubular object of Interest shovwng different bends. The object of interest may be 
represented In a gray level 3-D image. This metiiod comprises: computing a 3-D path that 
corresponds to the centeriine of a tubular object of Interest to segment; defining segments on 
said 3-D path; creating an initial straight deformable cylindrical mesh model, of any kind of 
mesh, with a length defined along its longitudinal axis equal to the length of the 3-D path; 
dividing this initial mesh model Into segments of length related to the different segments of the 
3-D path; and computing for each segment of the mesh, a rigid-body transformati'on that 
transforms the initial direction of the mesh into the direction of the related segment of the 3-D 
path, and applying this transformation to the vertices of the mesh con-espondlng to that 
segment. 

Now, a key problem lies In ttie potential apparition of self-intersections of the mesh 
model when, due to the bends of the 3-D path, the direction between two consecutive 
segments of the 3-D path changes quickly. 

It is an object of the present invention to propose such an Im^e processing method 
capable of limiting self-intersections of the deformable mesh model. Fbr limiting self- 
Intersections, the proposed method does not use a unique transformation for each segment, 
but Instead, the proposed method comprises computing transformations related to following 
segments, which transformations, are blended In between two consecutive segments. This 
technique is called 3-D rigid body transformation blending. When rotab'ons are used for 
following the directions of segments, a linear interpolation can be used between two rotations 
for rotation blending. This linear Interpolation, from one 3-D rigid body transformation to 
another one can be solved using the formalism of Quaternions. 
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An advantage of this technique of 3-D rigid body transfbmiation blending Is that the 
oration of the mesh model according the proposed method does not need to impose a kind of 
mesh model rather than another kind. The proposed method can be applied to mesh model of 
any kind: 2*slmplex mesh, triangular mesh or any other kind of transformable model. 
5 Unear fnterpofatfon of 3-D rigid transfomnatlon from one segment tx> the other does 

not always suffice to completely avoid self-Intersections. Clearly, such self-Intersections also 
depend on the relation between the local curvature of the 3-D path and the desired radius of 
the created discrete deformable model. If the latter is larger than the local radius of curvature, 
then self-Intersections occur. 

10 It Is an object of the present Invention to propose such an image processing method 

capable of avoiding possible self-Intersections in the regions of the tubular deformable model 
showing bends. The method of the present Invention comprises modulating the radius of the 
cylindrical deformable model according to the local curvature. Rrst, since the target 3-D path 
can be nothing more than a mere list of points, local curvature can be approximated. Then, the 

15 radius of the mesh model Is restricted In function of the curvature. However, In order to avoid 
sharp radius changes from one segment of the model to the other, a radius modulation 
technique b applied to Uie radius of the mesh model, such as linear blending or bl-cubic spline 
interpolation from one radius to the otiier. 

An advantage of this technique of radius modulation is that the surface of the mesh 

20 model. In the parts with restilcted radius obtained by radius modulation, does not present any 
discontinuity. The surface passes smoothly from a part: of a given radius bo another part: of 
restricted radius. Hence the mesh model does not appear to be deformed. Another advantage 
of tills technique of radius modulation is that it permits an improved segmentation of the 
complex organ of Interest In regions where numerous folding up may make visualization or 

25 followrtng of all the parts of this organ difficult The visualization Is improved. 

Another advantage of this technique of radius modulation is that the creation of the 
mesh model acxwrdlng the proposed method does not need to apply tmncation to the self- 
Intersecting parts of the bends, s\r\ce the radius of tiie mesh model Is restilcted. The avoided 
altemative of trunration ts a kind of operation that those skilled In the art: know to apply to the 

30 parts of the bends that self-intersects. Such truncation could be a solution for avoiding self- 
Intersections, but presents drawbacks such as suppression of information In the regions of 
curvatures and un-natural abrupt folds, which tiie present invention has for advantage to avoid. 

Still another problem may be lack of continuity control of the above-dted 
transformation, which can be seen as mesh torsion in the model. 

35 It is a ftirther object of the present Invention to propose such an Image processing 

method capable of minimizing Mesh Torsion. Mesh torsion is minimized when the distance 
between two consecutive nDtatfons of the rigid-body transformations is minimal. The proposed 
method comprises computi'ng the minimal 3-D rotation from the Initial mesh direction to the 
target segment. This rotation is defined with an axis parameter and with a rotation angle 
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parameter. The proposed method comprises computing these parameters iteratively from one 
segment to the other so that the new rotation for a current segment Is computed as a 
composition of the found n^tatJon for the previous segment and the minimal rotation from the 
previous and the current segment 
5 The main features of the proposed image processing method are claimed In Claim 1. 

The method of the Invention can favorably be applied to the segmentation of three-dimensional 
medical images of tubular body organs. The Invention also relates to a medical examination 
imaging apparatus having 3-D image processing means. The medical Imaging apparatus may be 
any 3-D medical examination apparatus having Imaging means. The invention further relates to 
10 a program product or a program paclcage for carrying out the method. 

Brief Description of the Drawings 
The invention Is described hereafter In detail in reference to the following 
diagrammatic drawings, wherein: 

FIG.l illustrates the step of mesh bending segment by segment^ based on a 
15 predetermined path of ordered points; 

FIG.2 Illustrates the variation of the angle of the local tangent u(s) to the 3-D path 
with respect to the z-axis of the referential of the initial tubular model; 

i=IG.3A and FIG.3B illustrate respectively mesh creation without and with linear 
transformation blending, in circle views; 
20 FIG.4A and RG.4B illustrate respectively mesh creation without and with linear 

transformation blending, in simplex mesh views; 

RG.5 shows an example of bi-cubic spline interpolation on computed curvatures; 
HG.eA shows an example of mesh model creation with linear transformation blending 
and torsion minimization, from the path of a centeriine of a colon; 
25 RG.6B shows the example of FIG.6A related to a mesh model following the path of a 

centeriine of a colon, further modified by a step of radius modulation; 

FiG,7A and nG.7B illustrate mesh creation using the minimal rotation between the 
local tangent u(s) and the z-axIs without and with incremental rotation R(s), In mesh views; 
FIG.8A shows an initial tubular mesh model; FIG.8B shows a synthetic tortuous 
30 example of mesh creation with linear transPonmation blending and with incremental rotebon 
R(s) leading to torsion minimization; i=IG.8C shows tiie same example as l=IG.8B in an other 
orientation; and i=IG.8D shows the same example as FIG.6B with a finer resolution of the 3-D 
path; 

FIG.9 Illustrates a medical viewing system having means for carrying out the image 
35 processing method. 

Description of the preferred Embodiments 
The invention relates to an image processing method to be applied for example to a 
three-dimensional (3-D) digital image represented in gray levels. The image may represent the 
noisy three-dimensional surface of an organ called object of interest. In order to provide the 
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user with a better view of the oblect of Interest, for Instance with respect to the badcground, 
this object Is segmented. The segmented image permits the user of better studying or detecting 
abnormalities or diseases of the organ. In the present example, tlie object of Interest is a 
tubular organ, for instance the colon or an artery or the bronchi. The way the three-dlmensfanal 
5 Image is acquired is not part of the Invention. The segmentation method could be applfed to 
three-dimensional digital images of organs that can be acquired by ultrasound systems or X-ray 
apparatus or by other systems known of those skilled in the art. 

After the acquisition of the three-dimensional image representing the three- 
dimensional tubular object of Interest said image is segmented. The Image segmentation 

10 method is based on the utilfzatlon of 3-D deformable models, called active contours. According 
to the invention, any technique of creating a 3-D deformable model can be used without 
restriction. The segmentation operation consists in mapping the 3-D deformable Model onto a 
3-D substantially tubular object of Interest, such as a colon or artery. In this example, the 
object of interest shows a complex tubular shape comprising numerous bends. 

15 In the field of active contours, an initial mesh model has to be provided. Even If It Is 

always possible to start from any arbitrary shape of the mesh model. It is more robust and 
faster to start with a mesh model whose shape is dose to the desired shape of the organ to be 
segmented. Acconjing to the invention, creating an initial mesh model of the kind called simplex 
mesh, tn'anguiar mesh or any other kind of mesh model Is proposed, with a tubular structure 

20 fitting a 3-D path formed of a set of ordered points. This method is based on the creation of a 
long straight cylinder, which Is in tum bended or deformed to fit the 3-D path. 

The difficulty lies in the operation of deforming the straight initial tubular deformable 
Model appropriately in order to finally map correctly the entirety of the surface of the complex 
shape of this tubular body organ considering the complexity of said shape. 

25 1) Creating a tubular mesh model: 

Referring to RG.l, the segmentation of a tubular structure, like a blood vessel or like 
the colon, comprises to first create a 3-D path P. This 3-D path may advantageously be a 
centerifne of the organ corresponding to said tubular structure. The creation of this 3-D path P 
may be performed using path-tracking techniques known to those skilled In the art for providing 

30 the set of ordered points related the tubular structure. According to the invention, the 3-D path 
P Is converted Into a tubular mesh model. The initial mesh model Is a cylindrical mesh model. 
This Initial cylindrical mesh model Is defomied towards the tubular organ structure data. For 
this, functionality is needed in order to Initialize a mesh model from such a 3-D path P, instead 
of initializing a mesh model directly with an olgect surface as in the prior art publication 

35 [Deiingetbe]. 

As mentioned in the Introduction, any application aiming at segmenting tubular 
structures might benefit from an initial mesh mode! having a tubular shape. Since path-tracking 
tools are already known to those skilled in the art, they may be used to detBrmine a line of 
points related to the object of interest such as the centeriine of the tubular object of Interest to 
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be s^mented. Such a 3-D path P, or centerline, can guide trustfully the InlUalization process of 
the mesh model, leading not only to a faster but also to a more robust segnnentation tool for 
tubular structures. 

According to the Invention, the problem to be solved Is the creation of the tubular 
5 mesh model fitting the tubular organ to be segmented. The different inputs of the problem are: 

1) a sorted list of points lying along the 3-D path P. No assumptions are required 
yet on the regularity and the spacing of these points, but it will be demonstrated further that 
such constraints can really help In obtaining a smooth mesh model. 

2) the radius r of the cylinder, and 

10 3) the resolution of the cells. I.e. the "number of cell subdivisions" . 

The natural output is a mesh structure. 

Referring to FIG.l, a functionality for creating the cylinder basic form Is proposed. 
This functionality consists In creating along the z-axis of a predefined referential Ox, Oy, Oz, a 
set of points lying on drcular sections of the initial cylindrical mesh model, then linking the sets 
15 of points all together tx> create tiie simplex me^ structure, and finally applying a rigid body 
transformation to move this o^eated cylinder, which is initially aligned on the z-axis, towards its 
desired 3-D location. For generating a 3-D flexible tube called generalized cylinder, the method 
of the invention comprises starting from a straight cylinder, which is aligned on the z-axis, and 
which has a length s equal to the total length of the 3-D target path P. Then, the method 
20 comprises elastically warping this cylinder In order to fit the given 3-D path. 

Referring to RG.l, the present method first comprises steps of: 

computing a 3-D path related to the tubular object of interest; for example the 3- 
D path is the centerilne of a tubular object of interest to segment; 
defining segments on said 3-D path; 
25 creating an Initial straight deformable cylindrical mesh model, of any kind of 

mesh, with a length defined along its longitudinal axis equal to the length of the 3-D path; 

dividing this initial m^h model into segments of lengtii related to the different 
segments of the 3-D path; and 

computing for each segment of the mesh, a rigid-body transformation that 
30 transforms the initial direction of the mesh into the direction of the related segment of the 3-D 
path, and applying this transformation to the vertices of the mesh corresponding to that 
segment 

If the starting location of the straight cylinder is chosen to be at z-coordlnate 0, then 
the z-coordinate of each cylinder point can be used as a correspondence with the chord-length 
35 parameterization of the 3-D path. For each location p(s) of the path, the direction u(s) of the 
local tangent is determined. Then, the cylinder points having a z-coordinate equal to s are 
warped Into the plane issued from p(s} and orthogonal to u(s}. These basic operations are 
illustrated by FIG.l. 

However, some artifects might appear. 
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Rrst, If the 3-D path Is not smooth, for example because large angles exist 
between two consecutive segments of the poly-llne path, then the warped cylinder might cross 
itself, thus leading into an undesirable self Intersecting mesh. Thus, a key problem is the 
potential apparition of self-intersections when the direction between two consecutive segments 

5 changes quickly. 

Then, when no care is taken with the choice of the rigid body transformation 
matching the z-axis into the uCs) orientation, this might lead to an undesirable torsion of the 
resulting mesh. Thus, another problem Is the lack of continuity control, which can be seen as 
mesh torsion, during the transformation. 

10 2) Limiting or avoiding self-intersections: 

A first cause of self-intersections is the rapid change of direcbon u(s) between two 
consecutive segments of the poly-line path. If the angle, denoted by 9, between the local 
tangent u(s) and the z-axis is plotted,, a step-curve formed of steps as shown in FIG.2 Is 
obtained. The steps are the horizontal segments A, B,.., represented in continuous lines in 

15 RG.2. Since this angle 9 is directly used for computing the rigid-body transformation of each 
circle, as represented in HG.l, reducing the effect of the steps helps preventing self- 
intersecQons. 

Fteferring to FIG.2, fDr reducing the effect of steps, the computed rotation for 
operating warping, corresponding to the segment "A" of the 3-D path, will be constant, and all 

20 the dides located between z=0 and z-1 will be rotated with the same 3-D rotation. Similarly, 
all the circles corresponding to segment "B", f.e. having a z-coordlnate in ttie range [1..2], will 
move with the same rigid body transformaUon. It is to be noted that, not only a 3-D rotation 
angle has to computed, but also a rotation axis, and similarly to the rotation angle, the rotation 
axis Is piecewise constant along the s coordinate. 

25 2a) Limiting self-intersections by using linear blending: 

Self-intersections can be avoided if a unique transformation is not applied for each 
segment. Instead, the transfomnations are blended in between two consecutive segments using 
linear interpolation between two rotations. This linear interpolation from one 3-D rigid body 
transformation to another one can be easily solved using the formalism of Quaternions. Hence, 

30 according to the invention. In order to limit the self-intersections, the method comprises linearly 

blending the 3-D transformation between each segment, /.e. replacing the step-curve fornied of 

segments A, B, etc, by the continuous curve represented by a doted line in FIG.2. This linear 

blending Is achieved by considering the 3-D rotations as Quaternions (denoted by Qi, and Q2) 

with a quatemion of the form shown in (1): 

9 9 
35 Q = cos + (l.ux + j.Uy + k.U2:) sin — (1) 


where 9 Is the rotation angle, and ( Ux , Uy , Uz ) the rotation axis. The blending itself Is then 
straightfbnA^rdly a normalized linear cximbinatlon of the two Quaternions Qi, Q2: 
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cos y + (Lu x+j.u y +k.u ^ ) sifi — 


(2) 


Non-linear blending could be Investigated. But, for the example of tubular organ 
segmentation, the linear blending was proven stable enough. 

F=IG.3A and RG.3B show the effect of the rotation blending on a 3-D path containing 
only 8 points, and also having quite large angle change from one segment to the other. In 
HG.3A, It can be seen that, without 3-D rotation blending, the different drdes intersect at the 
juncHon points, such as at points la, 2a, 3a, and the generated simplex mesh contains some 
self-intersecHons. In RG.3B, it can be seen that the linear blending of the rotations helps the 
different circles to being deformed smoothly from one direction to the following one, resulting 
In a much more regular mesh, as shown at points lb, 2b, 3b. 


Linear blending of 3-d rigid transformation from one segment to the other does not 
always suffice to avoid self-Intersections, aearly, such self-Intersectfons also depend on the 
relation between the local curvature of the 3-D path and the desired radius of the created 
mesh. If the latter Is larger than the local radius of curvature, knowing that the radius of 
curvature Is inversely proportional to the curvature, thus it Is small when the curvature Is high, 
then self-intersections occur. Thus, even if a smooth evolution of the rigid body transformation 
along with the s-coordinate is assured by the above-described operation of linear-blending, 
some self-lntersecOon might still appear. The relation that exists between the radius, denoted 
by r, of the initial cylinder, the distance separating two consecutive circles, and the curvature, 
denoted by c, of the 3-D path, might influence the creation of such self-Intersections. Trying to 
warp a cylinder with a large radius r on a very bent path will certainly lead to some serious 
problems. Hence, It is desirable to automatically reduce locally the diameter of the cylinder In 
highly curved zones. According to the Invention, the mesh radius is adapted automatically, 
based on the curvature and sample distance of the points and the desired Input radius. The 
method for tubular mesh creation comprises modulating the radius of the cylindrical mesh 
according to the local curvature* A shrinking factor combined with the 3-D rotation is calculated, 
thus leading to a similarity transfomr), provided that the curvature of the 3-D path can be 
computed at any point Since the Invention Is related to organs, it is assumed that the provided 
polyline Is smooth enough to use simple approximations. The curvature c(t) at curvilinear 
coordinate s=t of the 3-D path is computed as: 


where the first and second derivatives of the path are estimated with formulations (4) and (5): 


2b) Avoiding self-intersecUons by using automatic radius modulation: 



|3 


(3) 



||pt-.lPt|+|ptPtTlI 


Pt-lPt+1 


(4) 
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a^P(^) ^ ^(ptPt-2'>-PtPt+2) (5) 

[||pt-2Pt-ll + ||pt-lPt| + [ptPt+ll + [pt+lPt+zl) 

This IS only valid when the length of each segment tends to zero and when they are 
quite homogeneous. To overcome this small regularity problem and to avoid large variation of 
the estimated curvature, a Gaussian filtering of the curvature values can be applied. Rnally the 
5 computed curvature value for each point of the 3-D path Is used to apply a shrinking factor to 
the different drdes of the cylinder. This shrinking factor, denoted by k, depends on the radius 
of the IniHal cylinder r and the estimated radius of curvature, equal to 1/c, of the 3-D patti: 

j^^fllfr.c(t)<=l (6) 
\l/(rx:(t)) elsewhere 

Optionally, as with the rotation blending above, the shrinking factor can also be 
10 blended. The radius modulation technique can use a linear blending based on: 
(l-u)c(to) + uc(ti) (7) 
with u = x-(t-to)/(ti-to), (8) 
or this radius modulation technique can use a bi-cubic spline interpolation can be used, where u 
Is replaced by v so that: 
15 v = 3x2 -2x3. (9) 

H6.5 shows an example of bi-cubic interpolab'on on computed curvatures. The 
curvilinear coordinates s relates to the segment indices. The bold lines represent some sample 
values of radius of curvatures 1/c, where c is tine curvature, computed at locations s = 0 
through s = 5. And the curve represented by a fine line shows the bl-cubic interpolation of 
20 these sparse date. The advantage of using a bi-cubic interpolation here \n comparison with a 
linear one is that the function has a continuous derivative (the tangents at the junction points 
are horizontal), hence the variation of the cylinder radius will vary slower. 

After all these precautions. If self-Intersections still exists, then automatic mesh 
repairing, smoothing with internal force of the active contour algorithm might be applied, as 
25 described In the Introduction part In relation witii the transformations described In the prior art:. 

HG.6A and RG.6B Illustrate the benrfit of automatic radius modulation. RG.6A and 
nG.6B show an example of mesh creation from a path In the colon. In RG.6A, where the mesh 
model Is created without using radius modulation, the colon mesh self-Intersects in the bottom 
part 10a, where the 3-D path is very tortuous. Also, It very difficult to visualize some regions of 
30 the colon that are hidden by the bends of other regions. In RG.6B, where the mesh model is 
created using the radius modulation algorithm, the self-intersections are largely reduced as 
shown In 10b. However, the general shape of the colon is not perturbed In the regions of 
restricted radii. In the other parts such as 11a, the radius is unchanged between RG.6A and 
RG.6B. In the r^lons of restricted radii, the visualization and following of tiie different regions 
35 of the colon is greatly improved. 
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3) Imposing minimal torsion: 

Mesh torsion is minfmlzed when the distance between two consecutive rotations, i, e. 
rigid-body transfornnatfons. Is minimal. The 3-D rotation Is computed as the minimal rotation 
from the Initial mesh direction, which is the z-axis, to the target segment u{s). This rotation Is 
5 defined with an axis R = z u(s), and with angle e = angle(z,u(s)). According to the invention, 
tiie parameters constituted by the axis R and the angle 9 are computed iteratively fifom one 
segment to the other. Thus, this method cx^mprises computing the new rotation for a current 
segment u(s+l) as a composition of the found rotation for the previous segment u(s) and the 
minimal rotation from the previous segment u(s) to the current segment u(s+l). In fact, there 
10 is no unique 3-D rigid body transformation that maps the z-axis into the u(s) direction, which Is 
the local tangent of the 3-D path. If a translation is needed, such a translation Is easy to 

compute. But, the core problem consists in finding a 3-D rotation transforming the z vector 

(0,0,1) Into uCs) = (Ux, Uy, Uz) . The simplest rotation Is the rotation around axis: 

R=:ZAU^, (10) 
15 which reduces to R = (-Uy , Ux/0) , with a rotation angle G equals to: 

9 = -arccos(u2 /[u^|) . (11) 
This rotation, which may be called for simplicity: 

R(2,u(s)) (12) 
maps the z vector to the u(s) direction, but any other rotation composed of a rotation around 

20 the z-axl5 (leaving the z-dlrection untouched) followed by R(z,u(s)) does It as well. 

Nevertheless, only one rotation fulfills the condition of minimal displacement and It is exactiy 
R(z,ii(s)) . The problem is that It must be taken care about the fact that no minimal torsion Is 
to be found between zand u(s) , but rather between each step going from u(s) to u(s+l) . 

Thus the rotation to be computed is not as easy as R(z, u(s)) , but corresponds to the 
25 Incremental compositions: 

R(s) = R(z, ii(0)) o R([i(0), ii(i)) o ... o R(u(s - 1), u(i)) , (13) 

where R(a,b) designates the minimal rotation mapping a into b. 

RG.7A and RG.7B IHustiiate the use of Imposing minimal torsion. RG.7A shows an 
example of mesh creation using only the minimal rotation between the z-axis and u(s). RG.7B 
30 shows an example of mesh creation using the minimal rotation between the z-axIs and u(s) and 
then the Inaemental rotation R(s) leading to a minimal torsion. In RG.7A, It can be seen that 
torsion appears on the mesh because the cells are twisted around Junction points, for example 
in regions 4a and 5a. Instead, In RG.7B, the cells are kept aligned all over the mesh. In 
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particular, the cells are well aligned In regions 4b and 5b corresponding to the regions 4a and 
5a of nG.7A. 

On a tortuous synthetic ©ample. It can also be observed that the minimal torsion 
algorittim gives fine results- FIG.8A represents an Initial tubular mesh model from which a 
tortuous synthetic example Is create and represented in FIG.8B and in FIG.8C under a 
different angle of view. FEG.BD represents the same ©cample, with a finer resolution of the 3-D 
path. In RG.BD, 200 segments were used In the 3-D path while In RG.8B and FIG.8C only 50 
segments were used In the 3-D path. In FIG-8A to FIG.8D, a straight line has been tagged In 
white on the Initial cylinder 10, allowing to assessing the torsion on the final mesh In following 
the corresponding lines 11, 12, 13. 

4) Desired initial conditions 

The above described method works with different kinds of 3-D paths. However, the 
best results are observed when no sharp angles are present. Hence, it is better to preliminary 
smooth the input 3-D path using any smoothing technique known to those skilled in the art. Still 
better results are also obtained when the segment lengths of the path are homogeneous. 

5) Medical viewing system and apparatus 

The above-described steps can be carried out by the viewing system of the Invention. 
Rg.9 shows the basic components of an embodiment of an Image viewing system In accordance 
to the present invention, ina)rporated in a medical examination apparatas. The medical 
examlnatfon apparatus 151 may Include a bed 110 on which the patient lies or another element 
for localizing the patient relative to the Imaging apparatus. Tlie medical imaging apparatus 151 
may be a CT scanner or other medical Imaging apparatus such as x-rays or ultrasound 
apparatus. The image data produced by the apparatus 151 is fed to data processing means 
153, such as a general-purpose computer, that carries out tiie steps of the method. The data 
processing means 153 Is typically assodated with a visualization device, such as a monitor 154, 
and an Input device 155, such as a keyboard, or a mouse 156, pointing device, etc. operative 
by the user so that he can interact with the system. The data processing device 153 Is 
programmed to implement a method of processing medical image data according to Invention. 
In particular, the data processing device 153 has computing means and memory means to 
perform the steps of the method. A computer program product having pre-programmed 
instrudfons to carry out the method may also be Implemented. 

The drawings and their description herein before Illustrate rather than limit the 
Invention. It will be evident that there are numerous alternatives that fell within the scope of 
the appended claims. Moreover, although the present Invention has been described In terms of 
generating Image date for display, the present invention Is intended to cover substantially any 
form of visualization of the image date Including, but not limited to, display on a display device, 
and printing. Any reference sign In a daim should not be construed as limiting the dalm. 
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Claims: 

1. An Image data processing method of automatic adaptation of 3-D surface Model to image 
features, for Model-based Image segmentation, comprising creating a defbmiable tubular mesh model 

5 for fitting a 3-D path composed of a set of onJered points and automatically adapting the mesh radius 
based on the curvature of the 3-D path and sample distance of the path points and a predefined Input 
radius. 

2. The Image processing method of Claim 1, of aeating the defonnable model with 2-slmplex 
10 meshes or triangular meshes or any other kind of meshes, having a tubular structure for fitting a 3-D 

path, which Is the centerline of a 3-D tubular object of interest that may present all kinds of 
curvatures, and of mapping the 3-D defonnable tubular mesh model onto the 3-D surface of the 
tubular object of Interest, which Is represented In a gray level 3-D image. 

15 3. The Image processing method of one of Claims 1 or 2, comprising: 

computing a 3-D path that corresponds to the centerline of a tubular object of interest to 
segment and defining segments on said 3-D path; 

creating an initial straight deformable cylindrical mesh model, of any kind of mesh, with a 
length defined along its longitudinal axis equal to the length of the 3-D path; 
20 dividing this initial mesh model into segments of length related to the different segments of 

the 3-D path; 

computing, for each segment of the mesh, a rigid-body transformation that transfomis the 
Initial direction of the mesh Into the direction of the related segment of the 3-D path, and applying 
this transfomiation to the vertices of the mesh con^esponding to that segment 

25 

4. The image processing metiiod of Claim 3, comprising computing rigid-body transformations 
related to the successive segments, which transformations, are blended in between two consecutive 
segments. 

30 5. The Image processing method of aalm 4, for limiting self-Intersections between bent parts 
of the mesh model, comprising computing rotations for rigid-body transformations between 
consecutive segments, wherein a linear Interpolation Is used between two rotations for 3-D rigid body 
transformation blending. 

35 6. The Image processing method of one of Claims 1 to 5, for avoiding self-Intersections in the 
bent regions of the tubular deformable mesh model together with sharp radius changes from one 
segment of the mesh model to the other, comprising: 

modulating the radius of the cylindrical deformable mesh model according to the local 
curvature of the 3-D path. 
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7. The image processing method of Qalm 6, comprising approximating the local curvature, and 
applying the radius modulation technique chosen among linear blending or bl-cubic spline 
interpolation from one radius to Oie other. 

5 

8. The image processing method of one of Qaims 1 to 7, for minimizing l^esh Torsion, 
comprising computing the minimal 3-D rotetton from the Initial mesh direction to a target segment 

9. The image processing method of Qaim 8, comprising defining rotation between segments 
10 with an axis parameter and with a rotation angle parameter and computing these parameters 

iteratively from one segment to the other so that the new rotation for a current segment is computed 
as a composition of the found rotation for the previous segment and the minimal rotation from the 
previous and the current segment. 

15 10. A medical viewing system comprising means for acquiring 3-D medical Image data of a 3-D 
object of interest having substanOaily tubular parts, a suitably programmed computer or a special 
purpose processor having circuit means, which are arranged to process tiiese image data according to 
the method as claimed In one of Claims 1 to 9; 

and display means to display the medical Images. 

20 

11. A medical examination apparatus having: 

Means to acquire a three-dimensional image of an organ of a body having substantially 
tubular parts; and 

a medical viewing system according to Qaim 10. 

25 

12. A computer program product comprising a set of Instructions for carrying out the method as 
claimed in one of Claims 1 to 9. 
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ABSTRACT 

An Image processing method, comprising acquiring an Image of a 3-D tubular object of 
interest to segment; computing a 3-D path that corresponds to the centerllne of the tubular object 
and defining segments on said 3-D path; creating an Initial straight deformable cylindrical mesh 

5 model, of any kind of mesh, with a length defined along Its longitudinal axis equal to the length of the 
3-D path; dividing this Initial mesh model Into segments of length related to the different segments of 
the 3-D path; computing, for each segment of the mesh, a rigid-body transformation that transforms 
the initial direction of the mesh into the direction of the related segment of the 3-D path, and applying 
this transformation to the vertices of the mesh corresponding to that segment. The method comprises 

10 avoiding self-intersections in the bent regions of the tubular deformable mesh model and sharp radius 
changes from one segment of the mesh model to the other, by adapting or modulating the radius of 
the cylindrical deformable mesh model according to the local curvature of the 3-D path, sample 
distance of the path points and a predefined input radius. 


Figure: RG.6A, 6B 
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